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GLOBAL  ASYMPTOTIC  CONTROLLABILITY  IMPLIES  INPUT  TO 

STATE  STABILIZATION* * * § 

MICHAEL  MALISOFF+ ,  LUDOVIC  RIFFORD*,  AND  EDUARDO  SONTAG§ 

Abstract.  The  main  problem  addressed  in  this  paper  is  the  design  of  feedbacks  for  globally 
asymptotically  controllable  (GAC)  control  affine  systems  that  render  the  closed  loop  systems  input  to 
state  stable  with  respect  to  actuator  errors.  Extensions  for  fully  nonlinear  GAC  systems  with  actuator 
errors  are  also  discussed.  Our  controllers  have  the  property  that  they  tolerate  small  observation  noise 
as  well. 

Key  words,  asymptotic  controllability,  Lyapunov  functions,  input  to  state  stability,  nonsmooth 
analysis 
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1.  Introduction.  The  theory  of  input  to  state  stability  (ISS)  forms  the  basis  for 
much  of  current  research  in  mathematical  control  theory  (see  [15,  22,  23]).  The  ISS 
property  was  introduced  in  [19].  In  the  past  decade,  there  has  been  a  great  deal  of 
research  done  on  the  problem  of  finding  ISS  stabilizing  control  laws  (see  [7,  8,  9,  12]). 
This  note  is  concerned  with  the  ISS  of  control  systems  of  the  form 

(1.1)  x  =  /( x)  +  G{x)u 

where  /  and  G  are  locally  Lipschitz  vector  fields  on  Rn,  /( 0)  =  0,  and  the  control 
u  is  valued  in  Rm  (but  see  also  §5  for  extensions  for  fully  nonlinear  systems).  We 
assume  throughout  that  (1.1)  is  globally  asymptotically  controllable  (GAC),  and  we 
construct  a  feedback  K  :  Kn  — ■>  for  which 

(1.2)  x  =  f(x)  +  G(x)K(x)  +  G(x)u 

is  ISS.  As  pointed  out  in  [3,  24],  a  continuous  stabilizing  feedback  K  fails  to  exist  in 
general.  This  fact  forces  us  to  consider  discontinuous  feedbacks  K,  so  our  solutions 
will  be  taken  in  the  more  general  sense  of  sampling  and  Euler  solutions  for  dynamics 
that  are  discontinuous  in  the  state.  By  an  Euler  solution,  we  mean  a  uniform  limit 
of  sampling  solutions,  taken  as  the  frequency  of  sampling  becomes  infinite  (see  §2  for 
precise  definitions).  This  will  extend  [19,  20],  which  show  how  to  make  C°-stabilizable 
systems  ISS  to  actuator  errors.  In  particular,  our  results  apply  to  the  nonholonomic 
integrator  (see  [3,  10],  and  §4  below)  and  other  applications  where  Brockett’s  condition 
is  not  satisfied,  and  which  therefore  cannot  be  stabilized  by  continuous  feedbacks  (see 
[21,  22,  25]). 
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Our  results  also  strengthen  [6] ,  which  constructed  feedbacks  for  GAC  systems  that 
render  the  closed  loop  systems  globally  asymptotically  stable.  Our  main  tool  will  be 
the  recent  constructions  of  semiconcave  control  Lyapunov  functions  (CLF’s)  for  GAC 
systems  from  [16,  17].  Our  results  also  apply  in  the  more  general  situation  where 
measurement  noise  may  occur.  In  particular,  our  feedback  K  will  have  the  additional 
feature  that  the  perturbed  system 

(1.3)  x  =  f(x)  +  G(x)K(x  +  e)  +  G(x)u 

is  also  ISS  when  the  observation  error  e  :  [0,oo)  — >  Kn  in  the  controller  is  sufficiently 
small.  In  this  context,  the  precise  value  of  e(t)  is  unknown  to  the  controller,  but 
information  about  upper  bounds  on  the  magnitude  of  e(t)  can  be  used  to  design  the 
feedback.  We  will  prove  the  following: 

Theorem  1.1.  If  (1.1)  is  GAC,  then  there  exists  a  feedback  I\  for  which  (1.3) 
is  ISS  for  Euler  solutions. 

The  preceding  theorem  characterizes  the  uniform  limits  of  sampling  solutions 
of  (1.3)  (see  §2  for  the  precise  definitions  of  Euler  and  sampling  solutions).  From 
a  computational  standpoint,  it  is  also  desirable  to  know  how  frequently  to  sample 
in  order  to  achieve  ISS  for  sampling  solutions.  This  information  is  provided  in  the 
following  semi-discrete  version  of  Theorem  1.1  for  sampling  solutions: 

Theorem  1.2.  If  (1.1)  is  GAC,  then  there  exists  a  feedback  I\  for  which  (1.3) 
is  ISS  for  sampling  solutions. 

This  paper  is  organized  as  follows.  In  §2,  we  review  the  relevant  background  on 
CLF’s,  ISS,  nonsmooth  analysis,  and  discontinuous  feedbacks.  In  §3,  we  prove  our 
main  results.  This  is  followed  in  §4  by  a  comparison  of  our  feedback  construction  with 
the  known  feedback  constructions  for  C°-stabilizable  systems,  and  an  application  of 
our  results  to  the  nonholonomic  integrator.  We  close  in  §5  with  an  extension  for  fully 
nonlinear  systems. 

2.  Definitions  and  Main  Lemmas.  Let  /Coo  denote  the  set  of  all  continuous 
functions  p  :  [0,  oo)  — >  [0,  oo)  for  which  (i)  p(0)  =  0  and  (ii)  p  is  strictly  increasing  and 
unbounded.  Note  for  future  reference  that  /Coo  is  closed  under  inverse  and  composition 
(i.e. ,  if  p\,p2  G  /Coo,  then  p^.pi  o  p2  £  /Coo)-  We  let  ICC  denote  the  set  of  all 
continuous  functions  ft  :  [0,  oo)  x  [0,oo)  — *  [0,oo)  for  which  (1)  /?(-,/)  €  /Coo  for  each 
t  >  0,  (2)  (3 (s,  •)  is  nonincreasing  for  each  s  >  0,  and  (3)  (3(s,t )  — »  0  as  t  — >  +00  for 
each  s  >  0. 

For  each  k  £  N  and  r  >  0,  we  define 

Mk  =  {measurable  u  :  [0, 00)  — >  Rfc  :  |tt|oo  <  00} 

and  Mk  :=  {u  £  Mk  :  |it|oo  <  r},  where  |  •  |oo  is  the  essential  supremum.  We  let 
||u(s)||/  denote  the  essential  supremum  of  a  function  u  restricted  to  an  interval  I.  Let 
|  •  |  denote  the  Euclidean  norm,  in  the  appropriate  dimension,  and 

rBk  :=  {x  £  Rfc  :  |x|  <  r) 

for  each  k  £  N  and  r  >  0.  The  closure  of  rBk  is  denoted  by  rBk,  and  bd(S')  denotes 
the  boundary  of  any  subset  S  in  Euclidean  space.  We  also  set 

O  :=  {e  :  [0,  00)  — >  R™},  sup(e)  =  sup{|e(i)|  :  t  >  0} 

for  all  e  £  O,  and  Ov  :=  {e  £  O  :  sup(e)  <  77}  for  each  77  >  0.  For  any  compact  set 
T  C  Rn  and  e  >  0,  we  define  the  compact  set 

Te  :=  {2  £  R"  :  min{|a;  —  p\  :  p  £  T}  <  s}, 


CONTROLLABILITY  AND  INPUT  TO  STATE  STABILIZATION 


3 


i.e. ,  the  “e-enlargement  of  T" .  Given  a  continuous  function 
ft:rxr^r:  {x, u)  >-►  /i(z,  u) 

that  is  locally  Lipschitz  in  x  uniformly  on  compact  subsets  of  R”  x  Rm,  we  let 
4>h(-,x0,u)  denote  the  trajectory  of  x  =  h(x,u)  starting  at  xQ  €  R”  for  each  choice 
of  u  €  A4m.  In  this  case,  4>h{-,x0,u )  is  defined  on  some  maximal  interval  [0,f),  with 
t  >  0  depending  on  u  and  xa.  Let  Ck  denote  the  set  of  all  continuous  functions 
<p  :  R"  — >  R  that  have  at  least  k  continuous  derivatives  (for  k  =  0,1).  We  use  the 
following  controllability  notion,  which  was  introduced  in  [18]  and  later  reformulated 
in  terms  of  ICC  functions  in  [22] : 

Definition  2.1.  We  call  the  system  x  =  h(x,u )  globally  asymptotically  control¬ 
lable  (GAC)  provided  there  are  a  nondecreasing  function  a  :  [0,  oo)  — »  [0,  oo)  and  a 
function  f3  €  ICC  satisfying  the  following:  For  each  x0  £  R",  there  exists  u  €  Mm 
such  that 

(a)  \<j)h(t,x0,u)\  <  0(\xo\,t)  for  all  t  >  0;  and 

(b)  |u(f)|  <  u(|a;0|)  for  a.e.  t>  0. 

In  this  case,  we  call  a  the  GAC  modulus  of  x  =  h(x,u). 

In  our  main  results,  the  controllers  will  be  taken  to  be  discontinuous  feedbacks,  so 
the  dynamics  will  be  discontinuous  in  the  state  variable.  Therefore,  we  will  form  our 
trajectories  through  sampling,  and  through  uniform  limits  of  sampling  trajectories, 
as  follows.  We  say  that  tt  =  {tQ,  t\,t2,  •  ■  •}  C  [0,  oo)  is  a  partition  of  [0,  oo)  provided 
t0  =  0,  ti  <  tl+-\  for  all  i  >  0,  and  t,  — »  +oo  as  i  — »  +00.  The  set  of  all  partitions  of 
[0,  00)  is  denoted  by  Par.  Let 

F  :  R"  x  Rm  x  Rm  -»  R”  :  (x,p,u)  ^  F(x,p,u ) 

be  a  continuous  function  that  is  locally  Lipschitz  in  x  uniformly  on  compact  subsets 
of  Rn  x  Rm  x  Rm.  A  feedback  for  F  is  defined  to  be  any  locally  bounded  function 
K  :  R"  — >  Rm  for  which  A'(0)  =  0.  In  particular,  we  allow  discontinuous  feedbacks. 
The  arguments  x,  p,  and  u  in  F  are  used  to  represent  the  state,  feedback  value,  and 
actuator  error,  respectively. 

Given  a  feedback  IC  :  R”  — >  Rm,  it  =  {t0,t\,t2, . . .}  £  Par,  xa  £  R",  e  £  O,  and 
u  £  A4m,  the  sampling  solution  for  the  initial  value  problem  (IVP) 

(2.1)  x(t)  =  F(x(t),  K(x(t)  +  e(t)),u(t)) 

(2.2)  ai(0)  =  xa 

is  the  continuous  function  defined  by  recursively  solving 

(2.3)  x(t)  =  F(x(t),K(x(ti)  +  e(ti)),u(t)) 

from  the  initial  time  up  to  time  Sj  =  ti  Vsup{s  £  [ti,  L+i]  :  x(-)  is  defined  on  [ti,  s)}, 
where  x(0)  =  xa.  In  this  case,  the  sampling  solution  of  (2.1)-(2.2)  is  defined  on  the 
right-open  interval  from  time  zero  up  to  time  f  =  inf{sj  :  s,;  <  L+i}.  This  sampling 

solution  will  be  denoted  by  t  1— >  x„(t',  x0,  u,  e)  to  exhibit  its  dependence  on  tt  £  Par, 

x0  £  R",  u  £  M  m,  and  e  £  O,  or  simply  by  x^,  when  the  dependence  is  clear  from  the 
context.  Note  that  if  s,;  =  t,,+\  for  all  i ,  then  t  =  +00  (as  the  infimum  of  the  empty 
set),  so  in  that  case,  the  sampling  solution  1 1— >  x^{t\  xa,  u,  e)  is  defined  on  [0,  00). 

We  also  define  the  upper  diameter  and  the  lower  diameter  of  a  given  partition 
tt  =  {t0,ti,t2,  •  •  •}  by 

d(7r)  =  sup(ti+i  -  ti),  d(7r)  =  inf(ti+1  -  tf) 

i>0  *>° 
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respectively.  We  let  Par(6)  :=  {7 r  £  Par  :  d(7r)  <  5}  for  each  <5  >  0.  We  will  say  that 
a  function  y  :  [0,  00)  — ■>  Rn  is  an  Euler  solution  (robust  to  small  observation  errors)  of 

(2.4)  x(t)  =  F(x(t),  K(x(t)),u(t)),  a;(0)  =  xa 

for  u  £  Mm  provided  there  are  sequences  7rr  £  Par  and  er  €  O  such  that 

(a)  d(7iy)  ->  0; 

(b)  sup(er)/d(7Tr)  — >  0;  and 

(c)  1 1— >  x^ft ;  x0 ,  u,  er)  converges  uniformly  to  y  as  r  — >  +00. 

Note  that  the  approximating  trajectories  in  the  preceding  definition  all  use  the  same 
input  u  (but  see  Remark  2.4  for  a  more  general  notion  of  Euler  solutions,  which  also 
involves  sequences  of  inputs) . 

This  paper  will  design  feedbacks  that  make  closed  loop  GAC  systems  ISS  with 
respect  to  actuator  errors.  More  precisely,  we  will  use  the  following  definition: 

Definition  2.2.  We  say  that  (2.1)  is  ISS  for  sampling  solutions  provided  there 
are  (3  £  ICC  and  7  £  /Coo  satisfying:  For  each  e,  M,  N  >  0  with  0  <  e  <  M,  there  exist 
positive  S  =  S(e,  M,  N)  and  k  =  k(s,  M,  N)  such  that  for  each  tt  £  Par(<5),  xa  £  MJ3n, 
u  £  Mf),  and  e  £  O  for  which  sup(e)  <  ftd(7r), 

(2.5)  \xn(t;x0,u,e)\  <  max{/3(M, t)  +'y(N),e} 
for  all  t  >  0. 

Roughly  speaking,  condition  (2.5)  says  that  the  system  is  ISS,  modulo  small 
overflows,  if  the  sampling  is  done  ‘quickly  enough’,  as  determined  by  the  condition 
7T  £  Par (5),  but  ‘not  too  quickly’,  as  determined  by  the  additional  requirement  that 
d(7r)  >  (1/fc)  sup(e).  In  the  special  case  where  the  observation  error  e  =  0,  the 
condition  on  d(7r)  in  Definition  2.2  is  no  longer  needed;  our  results  are  new  even  for 
this  particular  case. 

Notice  that  the  bounds  on  e  are  in  the  supremum,  not  the  essential  supremum. 
It  is  easy  to  check  that  Definition  2.2  remains  unchanged  if  we  replace  the  right-hand 
side  in  (2.5)  by  / 3(M ,  t)  +  7 (N)  +  e.  We  also  use  the  following  analog  of  Definition  2.2 
for  Euler  solutions: 

Definition  2.3.  We  say  that  the  system  (2.1)  is  ISS  for  Euler  solutions  provided 
there  exist  (3  £  ICC  and  7  £  /Coo  satisfying:  If  u  £  Aim  and  xa  £  R",  and  ift\—>  x(t) 
is  an  Euler  solution  of  (2.f),  then 

(2.6)  |ar(£)|  <  f3(\xa\,t)  +  7(|u|oo) 
for  all  t  >  0. 

Remark  2.4.  In  the  definition  of  Euler  solutions  we  gave  above,  all  of  the  approx¬ 
imating  trajectories  1 1— >  xnr(t;  x0,  u,  er)  use  the  same  input  u  £  A4m.  A  different  way 
to  define  Euler  solutions,  which  gives  rise  to  a  more  general  class  of  limiting  solutions, 
is  as  follows:  A  function  y  :  [0,oo)  — >  R"  is  a  generalized  Euler  solution  of  (2.4)  for 
u  £  Mm  provided  there  are  sequences  7rr  £  Par,  er  £  O ,  and  ur  £  Mm  such  that 

(a)  d(?rr)  0; 

(b)  sup(er)/d(7Tr)  ->  0; 

(c)  1 17 1 00  <  |  it  |oo  for  all  r;  and 

(d)  1 1— >  xn r(i;  xa,ur,  er)  converges  uniformly  to  y  as  r  — >  +00. 

We  can  then  define  ISS  for  generalized  Euler  solutions  exactly  as  in  Definition  2.3,  by 
merely  replacing  “Euler  solution”  with  “generalized  Euler  solution”  throughout  the 
definition.  Our  proof  of  Theorem  1.1  will  actually  show  the  following  slightly  more 
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general  result:  If  (1.1)  is  GAC,  then  there  exists  a  feedback  K  for  which  (1.3)  is  ISS 
for  generalized  Euler  solutions. 

Our  main  tools  in  this  paper  will  be  nonsmooth  analysis  and  nonsmooth  Lyapunov 
functions.  The  following  definitions  will  be  used.  Let  O  be  an  arbitrary  open  subset 
of  R".  Recall  the  following  definition: 

Definition  2.5.  Let  g  :  Cl  — »  R  be  a  continuous  function  on  Cl;  it  is  said  to  be 
semiconcave  on  0  provided  for  each  point  xQ  £  Cl,  there  exist  p,  C  >  0  such  that 

g(x)  +  g{y)  -2g  ^c\\x~y\\2 


for  all  x,  y  £  x0  +  pB„ . 

The  proximal  superdifferential  (respectively,  proximal  subdifferential)  of  a  function 
V  :  LI  — >  R  at  x  €  Cl,  which  is  denoted  by  dpV(x )  (resp.,  dpV(x)),  is  defined  to  be 
the  set  of  all  C  £  Rn  for  which  there  exist  a,  p  >  0  such  that 

V(y)  -  V(x)  -  a\y  -  x\2  <  (C,  y  -  x)  (resp.,  V(y)  -  V(x)  -  a\y  -  x\2  >  (C,  y  -  x)) 

for  all  y  £  x  +  TjBn.  The  limiting  subdifferential  of  a  continuous  function  V  :  O  — >  K. 
at  x  £  O  is 


dLV(x)  :=  {q  £  Rn  :  3xn  —>  x  &  qn  £  dPV(xn )  s.t.  qn  —>  q}. 

In  what  follows,  we  assume  h  :  Rn  x  Km  — ■>  :  (x,  u )  i— >  h(x,  u)  is  continuous, 

that  it  is  locally  Lipschitz  in  x  uniformly  on  compact  subsets  of  R"  x  Rm,  and  that 
h( 0,0)  =  0.  The  following  definition  was  introduced  in  [18]  and  reformulated  in 
proximal  terms  in  [22]: 

Definition  2.6.  A  control-Lyapunov  function  (CLF)  for 

(2.7)  x  =  h(x,  u) 

is  a  continuous,  positive  definite,  proper  function  V  :  R"  — >■  R  for  which  there  exist 
a  continuous,  positive  definite  function  W  :  Rra  — ■>  R,  and  a  nondecreasing  function 
a  :  [0,  oo)  — y  [0,  oo),  satisfying 

VC  G  dPV(x),  inf  (C,h(x,u))  <  -W(x) 

\u\<a{\x\) 

for  all  x  £  R".  In  this  case,  we  call  (V,  W)  a  Lyapunov  pair  for  (2.7). 

Recall  the  following  lemmas  (see  [17]): 

Lemma  2.7.  If  (2.7)  is  GAC,  then  there  exists  a  CLF  V  for  (2.7)  that  is  semi¬ 
concave  on  Rn  \  {0},  and  a  nondecreasing  function  a  :  [0,  oo)  — >  [0,  oo),  that  satisfy 

(2.8)  \/(£dLV{x),  min  (C ,  h(x ,  u))  < -V (x) 

\u\<a(\x\) 

for  all  x  £  R". 

Lemma  2.8.  Let  V  :  Ll  — >  R  be  semiconcave.  Then  V  is  locally  Lipschitz,  and 
0  8lV(x )  C  dpV(x)  for  all  x  £  Cl.  Moreover,  for  each  compact  set  Q  C  Cl, 
there  exist  constants  <j,  g  >  0  such  that  V(y)  —  V(x)  —  cr| y  —  x\2  <  ((,y  —  x)  for  all 
y  £  x  +  pBn,  all  x  £  Q,  and  all  C  £  dpV(x). 

Notice  that  Lemma  2.8  allows  the  constants  in  the  definition  of  dpV(x)  to  be 
chosen  uniformly  on  compact  sets. 
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Remark  2.9.  In  [17],  the  controls  u  take  all  their  values  in  a  given  compact  metric 
space  U .  The  precise  version  of  the  CLF  existence  theorem  in  [17]  is  the  same  as  our 
Lemma  2.7,  except  that  the  infimum  in  the  decay  condition  (2.8)  is  replaced  by  the 
infimum  over  all  u  €  U.  The  version  of  Lemma  2.7  we  gave  above  follows  from  a 
slight  modification  of  the  arguments  of  [16,  17],  using  the  GAC  modulus  in  the  GAC 
definition  (see  Definition  2.1).  The  existence  theory  [16]  for  semiconcave  CLF’s  is  a 
strengthening  of  the  proof  that  continuous  CLF’s  exist  for  any  GAC  system  (see  [18]). 

3.  Proofs  of  Theorems.  Let  V  be  a  CLF  satisfying  the  requirements  of  Lemma 
2.7  for  the  dynamics 

(3.1)  h(x,u)  =  /( x)  +  G{x)u. 

Define  the  functions  a,  a  G  /Coo  by 

(3.2)  a(s)  =  min{|x|  :  V(x)  >  s}  and  a(s)  =  max{|x|  :  V(x)  <  s}. 

One  can  easily  check  that 

(3.3)  Vx  G  K",  a(V(x))  <  |x|  and  a(V(x))  >  \x\. 

Moreover,  by  reducing  a,  we  may  assume  that  a(s)  <  s  for  all  s  >  0,  while  still 
satisfying  (3.3). 

Let  x  i— >  £(x)  be  any  selection  of  d^V(x)  on  R”  \  {0},  with  £(0)  :=  0.  For  each 
x  G  R",  we  can  choose  u  =  ux  €  a(\x\)Bm  that  satisfies  the  inequality  in  (2.8)  for  the 
dynamics  (3.1)  and  £  =  C(x)-  Define  the  feedback  K\  :  Rn  — +  Km  by  A'i(^)  =  ux  for 
all  x  ^  0  and  K\  (0)  =  0.  We  use  the  functions 

(  ,  a(x)  =  (C (x),f(x)  +  G(x)K1(x)),  bj{x)  =  {C(x),gj(x))  Vj 

K2{x)  =  -P(x)(sgn{6i(x)},sgn{62(a;)},...,sgn{6m(x)})'r  ’ 

where  gj  is  the  jth  column  of  G  for  j  =  1, 2, . . . ,  m,  and 

r  i,  s  >  o 

sgn{s}  =  <  —1,  s  <  0  . 

[  0,  s  =  0 

We  remark  that  our  results  remain  true,  with  minor  changes  in  the  proofs,  if  the 
factor  —V(x)  in  the  definition  of  K2  is  replaced  by  —  W(x)  for  an  arbitrary  positive 
definite  proper  continuous  function  W  :  R”  — ■>  R.  In  particular,  K  :=  K\  +  K2  is  a 
feedback  for  the  dynamics 


F(x,p,u )  =  f(x)  +  G(x)(p  +  u). 

Moreover, 

(3.5)  a{x)  <  -V(x)  <0  Vx  G  R"  \  {0}. 
We  next  show  that 

(3.6)  x(t)  =  F(x(t),K(x(t)  +  e(t)),u(t)) 


is  ISS  for  sampling  solutions. 
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To  this  end,  choose  s,  M,  N  >  0  for  which  0  <  £  <  M.  It  clearly  suffices  to  verify 
the  ISS  property  (2.5)  for  s  <  1,  since  that  would  imply  the  property  for  all  overflows 
£  >  0.  Choose 

(3.7)  u  £  e  £  C?e/i6,  xQ  £  MBn. 

In  what  follows,  x „  denotes  the  sampling  solution  for  (3.6)  for  the  choices  (3.7)  and 
7 r  £  Par,  and  xn  is  the  (possibly  discontinuous)  function  that  is  inductively  defined 
by  solving  the  IVP 

x(t)  =  f(x(t))  +  G(x(t))[ K(xi)  +  u(t)],  xfc )  =  Xi 

on  [U,ti+ 1),  where  Xi  :=  Xi  +  e(U),  Xi  :=  xn(ti),  and  7r  =  {t0,  ti,  t?, . . .}.  We  later 
restrict  the  choice  of  7r  so  that  and  xn  are  defined  on  [0,  oo).  We  will  use  the 
compact  set 


Q  =  {  [a  o  a~\N  +  M)  +  l]  Bn }  \  sBn. 

Notice  that  Q1  Qe /2  C  K™  \  {0},  and  that  x0  £  Qe .  Using  Lemma  2.8  and  the 
semiconcavity  of  V  on  K"  \  {0},  we  can  find  er,  [i  >  0  such  that 

(3.8)  V(y)  -V(x)  <  (C (x),y-  x )  +  cr\y  -  x\2 

for  all  y  £  x  +  yBn  and  x  £  Qe /2.  Let  Ce  >  1  be  a  Lipschitz  constant  for  V  on  Q£ /2, 
the  existence  of  which  is  also  guaranteed  by  Lemma  2.8.  It  follows  from  the  definition 
of  a  CLF  that 

/oq'v  A-  :=min{V(p)  :  p  £  Q£/2} 

A+  :=  max  { V(p)  :  p  £  Qe} 


are  finite  positive  numbers.  Therefore,  we  can  choose  e  £  (0,£)  for  which 


(3.10)  o 
We  can  also  find 

(3.11) 

such  that  if 


(p  +  <  a(p)  +  |  Vp  £  [0,  a  1{N)  +  A+]  . 


5  =  S{s,  M,  N)  £  0 


16  +  A+  +  16A+ 


(3.12)  7r  G  Par(<5),  e  £  Og/\ g,  Xi  €  Q~ , 

and  if  t  £  [U>ti+ 1)  is  such  that  x„(s)  and  x„(s)  remain  in  Q2s  for  all  s  £  \ti,t\,  then 


(3.13)  max{| x^(t)  -  Xi\,  \ xn(t)  -  Xi\}  <  min  |/x,  y  **) 

This  follows  from  the  local  boundedness  of  K,  f  and  G.  It  follows  from  (3.13)  that 
x1 T(t)  £  Qe/A  (resp.,  x„(t)  £  Qe /4)  for  all  t  £  [U,ti+ 1)  and  all  i  such  that  x*  £  Q 
(resp.,  Xi  £  Q),  since  the  trajectories  cannot  move  the  initial  value  more  than  ^  and 
there  are  no  blow  up  times  for  the  trajectories.  In  particular,  (3.13)  will  show  that 
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x„  and  Xu  are  defined  on  [0,  oo),  since  the  argument  we  are  about  to  give  shows  that 
Xi  £  Qe  for  all  i.  By  reducing  5  as  necessary,  we  can  assume 


(3.14) 


||C(ii)  •  (F(xi,K(xi),u(s))  -  f(xw (s)) 
-G(xn(s))[u(s)  +  K(xi)])  ||[t4)ti+1)  < 


A_ 


for  all  i  such  that  Xi  £  Q£/2.  This  follows  from  the  Lipschitzness  of  /  and  G  on  Q£. 
Having  chosen  S  to  satisfy  the  preceding  requirements,  pick  any  7 r  £  Par(<5).  It  follows 
from  (3.8)  and  (3.13)  that 


(3.15) 


^{.X-nit))  h  (^y )  A  (C(*^l)  5  Xn  (t)  Xi)  Tcr|x7r(t)  Xi 


<  {C(xi),xn(t)  -  Xi)  +  4-(f  -  ti) 


for  all  t  £  [U,ti+ 1)  and  all  i  such  that  x-i  £  Qe /4.  Moreover,  if  £  Qe /4  and 
t  £  1),  and  if 


(3.16) 

then 


V{xi)  >  N, 


(C (&i),xn(t)  -  Xi)  <  (^(Xi),  F(xilK(xi),u(s))ds^  +  ^( i  - )  (by  (3.14)) 
=  (t-  ti)(C(xi),  f(xi)  +  G(xi)K(xi)) 

+  J  (C{xi),G(xi)u(s))ds+^-(t-ti) 


(3.17) 


<(t~  ti)a(xi)  -  (t  -  ti)V(xi)  Y  I 


1= i 


A_ 


+  N(t  ~  U)  Y  M^)l  +  -  ti) 

3= 1 

<(t~  ti)a(xi)  +  ^-(t  -  ti)  (by  (3.16)) 

<  -(t  -  ti)V(xi)  +  ^(t  -  ti)  (by  (3.5)). 


Let 


S  =  {x  £  Rn  :  V(x)  <  a-^N)}. 

Then  S  C  Qe .  Indeed,  x  £  S  implies 

aoa-1(|x|)  <  aoa-1  oaob(i)  <  N, 

and  therefore  \x\  <  a  o  a^1(N).  By  further  reducing  e,  we  can  assume  (2 e)Bn  C  S. 
If  Xi  £  Qe,i  but  Xi  ^  S,  then  V(xi)  >  a-1(-/V)  >  N,  so  (3.9)  and  (3.15)  give 

V(xn(t))  -V(xi)  <  -(t  -  ti) V ^  +(t-  U )^ 

<  -0 t-ti )V^>-  Vf  £  [ti,ti+1). 


(3.18) 
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Let  Cf  and  Cq  be  Lipschitz  constants  for  /  and  G  restricted  to  Qe,  respectively. 
Define  the  constants 


(3.19) 


R  =  N  +  sup  { \K(x) |  :  x  G  Q£ /2 }  , 

L  =  Cf  +  RCc,  k  =  k(£,M,N)  := 


min{A_,  e} 
16£e(ei5  +  l)' 


We  will  presently  show  that 
(3.20) 


sup  \xv(t)  —  x„(t)\  <  \e(ti)\eLS  Mi  s.t.  x*  G  Qe^4. 

ti<t<ti+ 1 

Using  (3.20),  we  will  now  find  /3  €  ICC  and  7  G  K.  to  satisfy  the  ISS  estimate 
(3.21)  | £„■(*) |  <  0(\xo\,t)  +  y(N)  +  e  Mt  >  0 

which  will  prove  Theorem  1.2. 

To  this  end,  assume  x.;  G  Q ,  but  that  xt  ^  Se Z16.  Then  (3.13)  implies  xn(t)  and 
xv(t)  both  remain  in  Qe /4  on  [ti,U+ 1).  Moreover,  27  G  Qe/4  \  5,  by  the  choice  of  e  in 
(3.12).  Therefore,  if  t  G  [t»,  4),  and  if 


(3.22) 

then  the  choice  of  k  gives 


sup(e)  <  Kd(7r) 


V(xi+i)  -V(xi)  =  V(xi+i)  -  V(xw(ti+1))  +  V(x7r(ti+1))  -V(xi) 
+  V(xi)  -  V(xi) 

1  U  , 


(3.23) 


—  £-e\xi+l  ®ir(^j+ 1)| 

+  £e|e(U)|  (by  (3.18)) 
<£e|e(U)|eW-^— - 


:U(xi) 


U(xi) +£e|e(L)|  (by  (3.20)) 

Gt 

<  ^(U+1  -  U)  -  ^±^U(X,)  (by  (3.22)) 

(by  (3.9)) 

<_!i±UZ^na;i)  +  !i±^i|e(ii)|£e 

<  —  ^+1  ~  ^U(xj)  +  (t<+1J7*<)2A- 


16 


,  tj+i  \ 

<  — — r(x.) 


where  we  use 


U+i  -  U  <  d(7r)  <  S  <  1 


to  get  the  last  inequality.  Set 


J(<)  = 


16 


16  +  t 

for  all  t  >  0.  One  can  easily  check  that  Qe  contains  the  set 


Sv  :=  {p  -V(p)<  max{U((?)  :  |<jr|  <  M  +  N}}. 
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In  fact,  p  £  Sy  implies 

\p\  <  a(ma,x{V(q)  :  |g|  <  M  +  N}) 

=  max{a  o  a o  a(V(q))  :  \q\  <  M  +  N} 

<ao  a~1(M  +  N). 

In  particular,  xQ  £  Sy-  It  follows  from  (3.23)  that  if  none  of  xa,  X\ ,Xj  lie  in  S'6/16, 
then 

V(Xi)  -V(X0)  <  -^7 V(Xj ) 

V(x2)-V(x1)<-t^V(xj) 

V(Xj)  -  <  -J  |(/.'  V(Xj). 

Summing  the  preceding  inequalities  would  then  give 

V{xj)-V(x0)  <  so  v(xj)  <  J(tj)V(x0)  . 

Hence, 


V(xi)  <  J(ti)V(x0)  for  i  =  0,1, . . . ,  j. 

By  the  choice  of  6  in  (3.11),  it  would  then  follow  from  (3.13)  that 

V(x7 r(t))  <  J(t)V(x0)  +  ^ 

up  to  the  least  time  t  at  which  x„(t)  €  Se Z16.  Hence,  for  such  t,  the  choice  of  e  (see 
(3.10))  gives 

|2Lr(t)|  <  a(j(t)V(x0)+  |) 

<  a  (J(t)V(x0))  +  | 

On  the  other  hand,  (3.23)  also  shows  that  if  xn(t)  £  Se^8  for  some  t,  then 
(3.24)  |xff(s)|  <  a  o  a_1(7V)  +  e  \/s>t. 

Indeed,  let  Si  be  the  first  sample  time  above  such  a  time  t.  Assume  xn(t)  £  eBn.  By 
(3.13),  xT(si)  £  Se /4  and  x7r(si)  \Bn.  Therefore,  there  exists  p  £  S  for  which 

V(Msi))  =  V(**(«i))  -V(p)  +  V(p) 

<Ce£-+a~\N). 

In  fact,  we  can  pick  p  =  xn(si)  if  xw(si)  £  S  and  p  £  dS  otherwise,  so  p  ^  § Bn. 
It  follows  from  (3.13)  and  (3.23)  that  for  the  next  sample  time  s7,  we  either  have 
xn(si)  £  S£ /8,  or  else  we  have 

V(xM)<Ce£-+a-\N). 
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In  the  first  case, 

|afir(s,:)|  <aoa~1(N)  +  |, 

while  in  the  second  case, 

|*ir(s»)|  <  a  <aoa~1(N)  + 

by  the  choice  of  e.  If  xn(s,)  $  Se Z16,  then  V (xn{si+\))  <  V(x7r(si))  (by  (3.23)),  so 
the  preceding  argument  also  gives 

Msi+i)|  <aoa~1(N)  +  C. 

By  repeating  this  argument  for  subsequent  sample  times,  the  assertion  (3.24)  then 
follows  from  (3.13).  Defining  (3  G  ICC  and  7  G  /Coo  by 

(3.25)  P(s,  t)  =  a  (a_1(s)  J(t))  ,  j(s)  =  a  o  a_1(s), 

it  follows  that  (3.21)  holds  for  all  x0  €  MBn,  u  G  Al™,  7 r  g  Par(<5),  and  e  G  O 
for  which  sup(e)  <  Kd(7r).  Therefore,  Theorem  1.2  will  follow  once  we  check  (3.20), 
which  is  a  consequence  of  Gronwall’s  Inequality. 

To  this  end,  notice  that  if  Xi  G  Qe /4,  then 

\xn(t)  -xn(t)\  <  | Xi  -Xi\  +  J  (. Cf\xn(s )  -*w(s)|  +RCG\xn(s)  -iw(s)|)ds 

for  all  t  G  1),  where  we  are  using  the  constants  in  (3.19).  It  follows  from 

Gronwall’s  Inequality  that 

\xn (t)  -  xn(t) |  <  | Xi  -  xi\eL^ti~u+^  <  \xi  -  Xi\eL^M  <  \e(ti)\eLS 

for  all  t  G  [U,ti+ 1),  which  is  (3.20).  This  proves  Theorem  1.2. 

We  turn  next  to  Theorem  1.1.  We  need  to  show  the  ISS  property  (2.6)  for  all 
Euler  solutions  x(t)  of  (2.4).  We  will  actually  prove  the  slightly  stronger  version  of 
the  theorem  for  generalized  Euler  solutions,  as  asserted  in  Remark  2.4.  To  this  end, 
choose  u  G  Mm,  xa  G  R",  and  £  >  0.  Using  our  previous  conclusion  that  (1.3)  is  ISS 
for  sampling  solutions,  we  can  let 

SE  =  S(e,  \x0\,  |«|oo)  and  Ke  =  k  (e,  \xQ\,  |u|<x>) 

be  the  constants  from  Definition  2.2.  Let  x(t)  be  a  generalized  Euler  solution  of 
(2.4),  and  let  7rr,  ur,  and  er  satisfy  the  requirements  of  the  generalized  Euler  solution 
definition.  It  follows  from  the  definition  that  there  is  an  f  G  N  such  that 

d(7rr)  <  8e,  sup(er)  <  Ked(7rr) 

for  all  r  >  f.  It  then  follows  from  (3.21)  that 

(3.26)  \xi Tr (/,  xG,  ur ,  er) \  A  Pi\x0 |,t)  T  7(  1^1 00)  T  £ 

for  all  t  >  0  and  r  >  f,  where  /?  and  7  are  in  (3.25).  The  ISS  condition  (2.6)  now 
follows  by  passing  to  the  limit  in  (3.26)  as  r  — >  00,  since  e  >  0  was  arbitrary.  This 
concludes  the  proof  of  Theorem  1.1. 
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4.  Stabilization  of  the  Nonholonomic  Integrator.  In  this  section,  we  illus¬ 
trate  how  the  feedback  constructed  in  §3  can  be  used  to  stabilize  Brockett’s  nonholo¬ 
nomic  integrator  control  system  (see  [3,  10,  22]).  We  will  also  use  the  nonholonomic 
integrator  to  compare  our  feedback  construction  to  the  feedbacks  from  [19,  20].  The 
nonholonomic  integrator  was  introduced  in  [3] ,  as  an  example  of  a  system  that  cannot 
be  stabilized  using  continuous  feedback.  It  is  well-known  that  if  the  state  space  of  a 
system  contains  obstacles  (e.g.,  if  the  state  space  is  R2  \  (—1,  l)2,  and  therefore  has 
a  topological  obstacle  around  the  origin),  then  it  is  impossible  to  stabilize  the  sys¬ 
tem  using  continuous  feedback.  In  fact,  this  is  a  special  case  of  a  theorem  of  Milnor, 
which  asserts  that  the  domain  of  attraction  of  an  asymptotically  stable  vector  field 
must  be  diffeomorphic  to  Euclidean  space,  and  therefore  cannot  be  the  complement 
M2  \  (—1,  l)2  (see  [21]). 

Brockett’s  example  illustrates  how,  even  if  we  assume  that  the  state  evolves  in  Eu¬ 
clidean  space,  similar  obstructions  to  stabilization  may  occur.  These  obstructions  are 
not  due  to  the  topology  of  the  state  space,  but  instead  arise  from  “virtual  obstacles” 
that  are  implicit  in  the  form  of  the  control  system  (see  [22]).  Such  obstacles  occur 
when  it  is  impossible  to  move  instantly  in  some  directions,  even  though  it  is  possible 
to  move  eventually  in  every  direction  ( “nonholonomy” ) .  This  gives  rise  to  Brockett’s 
criterion  (see  [3]),  which  is  a  necessary  condition  for  the  existence  of  a  continuous 
stabilizer,  in  terms  of  the  vector  fields  that  define  the  system  (see  [21,  22,  25]).  The 
nonholonomic  integrator  does  not  satisfy  Brockett’s  criterion,  and  therefore  cannot 
be  stabilized  by  continuous  feedbacks. 

The  physical  model  for  Brockett’s  example  is  as  follows.  Consider  a  three-wheeled 
shopping  cart  whose  front  wheel  acts  as  a  castor.  The  state  variable  is  (an,  x2,  9)T, 
where  (xi,x2)t  is  the  midpoint  of  the  rear  axle  of  the  cart,  and  9  is  the  cart’s  orien¬ 
tation.  The  front  wheel  is  free  to  rotate,  but  there  is  a  “non-slipping”  constraint  that 
{x\,x2)T  must  always  be  parallel  to  (cos(0), sin(0))T.  This  gives  the  equations 

±i  =  v\  cos (9) 

(4.1)  x 2  =  v\  sin(0)  , 

9  =  v2 

where  v\  is  a  “drive”  command  and  v2  is  a  steering  command.  Using  the  feedback 
transformation 

z\  :=  9 ,  z2  \=  X\  cos (9)  +  x2  sin(0),  Z3  :=  X\  sin(0)  —  x2  cos (9) 
u  1  :=  v2,  u2  :=  V\  —  v2z3 

followed  by  a  second  transformation,  brings  the  equations  (4.1)  into  the  form 

±1  =  Ml 

(4.2)  ±2  =  u2  , 

x3  =  X\U2  -  X2U\ 


which  is  called  the  nonholonomic  integrator  control  system. 

One  can  show  (see  [11])  that  (4.2)  is  a  GAC  system.  However,  since  Brockett’s 
condition  is  not  satisfied  for  (4.2),  the  system  has  no  continuous  stabilizer.  While 
there  does  not  exist  a  C 1  CLF  for  the  system  (4.2)  (see  [11]),  it  is  now  well-known 
that  every  GAC  system  admits  a  continuous  CLF  (see  [18]).  In  fact,  it  was  shown  in 
[10]  that  the  nonholonomic  integrator  dynamics  (4.2)  has  the  nonsmooth  CLF 


(4.3) 


V  ( x )  =  max 
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which  is  semiconcave  outside  the  cone  x\  =  4(xf +x|)  (see  [17]  for  a  detailed  discussion 
of  some  special  properties  of  this  CLF).  For  the  special  case  of  the  dynamics  (4.2) 
and  CLF  (4.3),  the  feedback  K  =  K\  +  K2  we  constructed  in  §3  is  as  follows. 

To  simplify  notation,  we  use  the  radius  r(x)  :=  \/ x\  +  x\.  We  also  use  the  sets 

S0  =  {i  £  I3  :  13  /  0,  r(x)  =  0} 

S+  =  {x  €  R3  :  x§  >  4?’2(x)  >  0} 

S-  =  {1  £  R3  :  13  <  4r2(x)} 

which  form  a  partition  of  R3  \  {0}.  Notice  that  V(x)  =  r(x)  on  S-,  and  also  that 
V(x)  =  |a;3 1  —  r(x)  on  R3  \  S-.  To  find  our  selection  £(x)  €  8lV(x),  we  first  choose 
C(0)  =  0,  and  £(x)  =  (0,  —  1, sgn{x3})T  for  all  x  £  S0-  Using  the  notation  of  (3.4), 
this  gives 


!( -x2sgn{x3}  -  xi/r(x),  xisgn{x3}  -  x2/r(x)  f ,  x  £  S+ 
(xi/r(x),  x2/r(x)  )T  ,  x  £  5_ 

(0,  — 1)T  ,  x£Sa 


and  6(0)  =  0.  Notice  that  1  <  |6(x)|2  <  r2(x)  +  1  for  all  We  also  have 

(  -x2sgn{x3}  -  xi/r(x),  xisgn{x3}  -  x2/r(x )  )T  ,  x  £  S+ 
—  (xi,x2)t  ,  x  £  S- 

(0,  |x3|)t,  X  £  So 


with  iLi(0)  =  0,  where  we  have  set 


m(x) 


r(x)  -  |x3| 
r2(x)  +  1 


In  this  case,  we  have  taken 


K  i(x)  =  — 6(x)U(x)/|6(x)|2 

for  i/O,  where  6(x)  is  defined  in  (4.4),  and  K\  is  continuous  at  the  origin.  On  the 
other  hand,  our  feedback  K2  from  (3.4)  becomes 


1*  (/z2(xi,-x2,x),  /z2(x2,xi,x)  )T, 

x  £  S+ 

K2{x)  =  -  \ 

1  r(x) (sgn{xi},  sgn{x2})T, 

X  £  S— 

l  l*3|(o,  -if, 

x  £  So 

with  K2{ 0)  =  0,  where  we  have  set 

/i2(a,b,x) 

:=  (  x3  -  r(x))  sgn{  6r(x)  sgn{x3} 

-a}. 

Since  V  is  semiconcave  on  Q  :=  R3\bd(S'_),  the  argument  from  §3  applies  to  sampling 
solutions  that  satisfy  the  additional  requirement  that  xn(s)  £  f2  for  all  s  >  0.  It  follows 
from  the  proof  of  Theorem  1.2  that  the  nonholonomic  integrator  system  (4.2)  can  be 
stabilized  for  both  actuator  errors  and  small  observation  errors  (for  this  restricted  set 
of  sampling  solutions),  using  the  combined  feedback  K  =  KA  +  K2. 

Remark  4.1.  In  this  example,  we  chose  to  work  with  the  CLF  (4.3)  because  it 
has  been  explicitly  proven  in  [10]  to  be  a  CLF  for  the  control  system  (4.2).  The 
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example  illustrates  how  to  extend  our  results  to  more  general  CLF’s  that  may  not  be 
semiconcave  on  R3  \  {0}.  For  such  cases,  the  ISS  estimates  hold  for  those  sampling 
solutions  that  remain  in  the  domain  of  semiconcavity  of  the  CLF.  On  the  other  hand, 
we  let  the  reader  prove  that  the  nonholonomic  integrator  system  also  has  the  CLF 

V{x)  =  (\/x\  +  xl-  +x\, 

which  is  semiconcave  on  R3  \  {0}  (as  the  sum  of  the  smooth  function  x\  +  x\  +  2x| 
and  a  semiconcave  function).  Therefore,  if  we  use  V  to  form  our  feedbacks,  instead 
of  the  CLF  (4.3),  then  our  theorems  apply  directly,  without  any  state  restrictions  on 
the  sampling  solutions. 

Remark  4.2.  The  results  in  [19]  designed  feedbacks  that  make  C°-stabilizable 
systems  ISS  with  respect  to  actuator  errors.  For  the  case  of  C°-stabilizable  systems, 
a  smooth  (i.e. ,  C°°)  Lyapunov  function  is  known  to  exist  (see  [1]).  In  [19],  the  system 
was  rendered  ISS  using  the  feedback 

(4.5)  K( x)  :=  -LgV{x)  =  -W(x)G(x), 

where  V  is  a  smooth  CLF  for  the  dynamics  (1.1).  In  that  case,  (4.5)  is  continuous 
at  the  origin.  However,  in  the  more  general  situation  where  the  system  is  merely 
GAC,  there  may  not  exist  a  smooth  Lyapunov  function,  so  V  must  be  taken  to  be 
nonsmooth.  In  this  case,  the  use  of  the  nonsmooth  analogue 

(4.6)  K(x)  :=  -C (x)G(x) 

of  (4.5)  (where  ((x)  G  8lV(x )  for  all  x  ^  0)  could  give  rise  to  a  feedback  that  would 
not  be  continuous  at  the  origin.  For  example,  if  we  use  the  nonholonomic  integrator 

(4.2)  and  the  CLF  (4.3),  then  K  takes  the  values 

*«e,e,on  =  -(T  _L)  ,  K((e.e,3^ty)  =  (A,_L)  +<1,-1  f 

so  K  is  discontinuous  at  the  origin.  On  the  other  hand,  our  choice  of  K2  is  automat¬ 
ically  continuous  at  the  origin. 

Remark  4.3.  Under  the  additional  hypothesis  that  (1.1)  satisfies  the  small  control 
property  (see  [21]),  the  system  can  be  stabilized  by  a  feedback  that  is  continuous  at  the 
origin  (see  [17]).  More  precisely,  suppose  there  exists  a  semiconcave  CLF  V  satisfying 
the  following:  For  each  £  >  0,  there  exists  5  =  5(s)  >  0  such  that  0  <  |x|  <  S  implies 

3ux  G  eBm  s.t.  VC  G  dPV(x),  ((,f{x)  +  G(x)ux)  <  -V(x). 

Then  the  system  can  be  rendered  globally  asymptotically  stable  (GAS)  by  a  feedback 
that  is  continuous  at  the  origin  (see  [17]).  For  the  case  of  the  nonholonomic  integrator 

(4.2) ,  the  system  is  GAS  under  our  feedback  K\ ,  which  is  continuous  at  the  origin, 
so  our  total  feedback  I\  =  K\  +  K2  is  continuous  at  the  origin  as  well. 

5.  ISS  for  Fully  Nonlinear  GAC  Systems.  We  conclude  with  an  extension 
of  our  results  for  fully  nonlinear  GAC  systems 


(5.1) 


X  =  f(x,u) 
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where  we  assume  for  simplicity  that  the  observation  error  e  in  the  controller  is  zero. 
We  assume  throughout  this  section  that 

/  :  r  x  r  ->  Kn  :  (x,  u )  f(x,  u) 

is  continuous  and  locally  Lipschitz  in  x  uniformly  on  compact  subsets  of  x  Rm 
and  /( 0, 0)  =  0.  It  is  natural  to  ask  whether  these  hypotheses  are  sufficient  for  the 
existence  of  a  continuous  feedback  K (a:)  for  which 

(5.2)  x  =  f(x,  K(x)  +  u) 

is  ISS  for  Euler  solutions.  However,  one  can  easily  construct  examples  for  which  such 
feedbacks  cannot  exist.  Here  is  an  example  from  [20]  where  this  situation  occurs. 
Consider  the  GAC  system  x  =  — x  +  u2x2  on  R.  If  K(x)  is  any  continuous  feedback 
for  which 

(5.3)  x  =  —  x  +  (K(x)  +  u)2x2 

is  ISS,  then  \K(x)\  <  x~x!2  for  sufficiently  large  x  >  0.  It  follows  that  the  solution  of 

x  =  —x  +  {K{x)  +  l)2x2 

starting  at  a;(0)  =  4  is  unbounded.  Therefore,  there  does  not  exist  a  continuous 
feedback  K  for  which  (5.3)  is  ISS.  On  the  other  hand,  one  can  find  a  (possibly  dis¬ 
continuous)  feedback  that  makes  (5.1)  ISS.  We  use  the  following  weaker  sense  of  ISS 
for  fully  nonlinear  systems  that  was  introduced  in  [20]: 

Definition  5.1.  We  say  that  (5.1)  is  input  to  state  stabilizable  in  the  weak 
sense  provided  there  exist  a  feedback  I\,  and  an  m  x  m  matrix  G  of  continuously 
differentiable  functions  which  is  invertible  at  each  point,  such  that 

x  =  F(x,  K(x),u ) 

is  ISS  for  sampling  and  Eider  solutions,  where  F(x,p,u)  =  f(x,p  +  G(x)u). 

We  will  prove  the  following: 

Proposition  5.2.  If  (5.1)  is  GAC,  then  (5.1)  is  also  input  to  state  stabilizable 
in  the  weak  sense. 

Proof.  We  modify  the  proof  from  §3.  We  define  V,  (,  a,  a,  and  K1  as  in  the 
proof  of  Theorem  1.2,  except  we  use  the  fully  nonlinear  dynamics  h  =  f  from  (5.1). 
Next  we  follow  the  proof  of  the  main  result  in  [20],  with  the  following  modifications. 
Define  the  (possibly  discontinuous)  function  V  by 

(5.4)  V(s,r )  =  sup  j(C(z),/(a:,  Kffx)  +  p))  +  :  |x|  =  s,  \p\  =  r  j  . 

For  any  interval  /  of  the  form  [i,i  +  1],  or  of  the  form  [jpy ,  \\,  for  i  £  N,  one  can  find 
r  =  r(i)  >  0  such  that  s  £  I  implies  V(s,b)  <  0  for  all  b  £  [0,r].  This  follows  from 
the  positive  definiteness  of  V,  the  local  Lipschitzness  of  /,  and  the  local  boundedness 
of  dpV  on  compact  subsets  of  R™  \  {0}. 

The  argument  of  [20]  therefore  gives  «4  £  /Coo  and  a  smooth,  everywhere  invertible 
matrix- valued  function  G  :  Rn  — >  Rmxm  satisfying  the  following:  If 


(5.5) 


M  >  cc4(|w(s)|  oo) 
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then  for  a.e.  t  >  0, 

{CWJiXiKt  {x)  +  G{x)u{t))) +V^-  <  V(\x\,  |G(a;)u(s)|(X))  <  0. 

(See  Remark  5.3  for  a  characterization  of  the  set  of  matrices  G  for  which  ISS  can 
be  expected,  in  terms  of  V.)  We  can  evidently  assume  that  «4(s)  >  s  for  all  s  >  0 
(e.g.,  by  replacing  aq(s)  by  max{a4(s),  s},  which  makes  the  condition  (5.5)  more 
restrictive).  Fix  M,  N,  e  G  (0 ,  M),  u  G  and  x(t)  =  xv(t)  as  before,  with  e  =  0. 
Define  the  compact  sets 

S  :=  {x  €  R"  :  V(x)  <  a-1  o  c^iV)}  ,  Q  =  {(a  o  a~1{M  +  cut (N))  +  1  )Bn}  \  eBn. 

Notice  that  S  C  Qe.  We  choose  i  as  before,  and  we  choose  <5  =  5{e,  M,  N ),  satisfying 
(3.11),  such  that  if  d(7r)  <  S,  then 

(5-6)  \x^{t)-Xi\  <  min|/x,  y 

for  all  indices  i  such  that  Xi  G  Qe  and  all  t  G  [£*,£,+ 1],  where  a  and  /j,  are  as  defined 
before,  and  A_  =  iriinlF (x)  :  x  G  Q^4}-  Reducing  S  as  necessary,  we  can  assume 

IIC(^)  '  [f(xl,K1(xi)  +  G(xi)u(s))  -  f(x(s),K1(xi)  +  G(*(s))u(s))]||[t.iti+1]  <  ^ 

for  all  indices  i  satisfying  Xi  G  Qe^2.  Reasoning  as  in  the  earlier  proof  gives 

V{xv (£))  -V(xi)  <  Vi  G  [ti,ti+ 1] 

for  all  i  such  that  Xi  G  Q£^  \  S.  The  remainder  of  the  proof  is  as  before,  except  with 
aoa'^JV)  replaced  by  ctoa"1(a4(Af)),  and  with  aoa_1(s)  replaced  by  Soa^1(a4(s)) 
in  the  definition  of  7.  This  proves  Proposition  5.2.  □ 

Remark  5.3.  The  statement  of  Proposition  5.2  is  an  existence  result  in  terms  of 
the  invertible  matrix  G.  However,  we  can  strengthen  the  proposition  by  using  the 
function  T>  in  (5.4)  to  characterize  the  class  of  G  for  which  ISS  can  be  expected,  as 
follows.  Following  [20],  we  first  choose  strictly  decreasing  sequences  {rt}  and  {r'|  of 
positive  numbers  such  that  0  <  77+1  <  r'  <  n  for  all  iGN,  and  such  that 

V(s,  r)  <  0  V(s,  r)  G  ([i,  *  +  1]  x  [0,  ry])  U  ([1  /(i  +  1),  1/i]  x  [0,  r']) 

for  all  jgN.  The  existence  of  these  sequences  follows  from  the  argument  we  gave  in 
the  proof  of  the  proposition.  Define  p  :  [0, 00)  — >  [0, 00)  by  setting: 

(pi)  p(s)  =  rk  for  all  s  G  [k,  k  +  1)  and  k  G  N; 

(p2)  p(s)  =  r'k  for  all  s  G  [1  /{k  +  1),  1/fc)  and  k  G  N;  and 
(p3)  p(0)  =  0. 

We  then  choose  any  smooth  function  q  :  [0,oo)  — >  (0, 00)  satisfying: 

(5I)  9(s)  —  1  for  all  s  G  [0, 1]; 

(c/2)  q[s )  <  p(s)/s  for  all  s  >  2;  and 
(c/3)  g(a)  <  1  for  all  s  >  0. 

The  existence  of  such  a  function  g  follows  from  exactly  the  same  argument  used  in 
[20] .  It  then  also  follows  from  the  argument  of  [20]  that  we  can  satisfy  the  conditions 
of  the  proposition  by  choosing  G(£)  =  </(|£|)J. 
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Proposition  5.2  allows  us  to  characterize  GAC  for  fully  nonlinear  systems  in  terms 
of  feedback  equivalence,  as  follows.  First  recall  that  two  systems  x  =  f(x,u)  and 
x  =  h(x,u),  evolving  on  R”  x  Rm,  are  called  feedback  equivalent  provided  there  exist 
a  locally  bounded  function  K  :  R™  — >  Rm  and  an  everywhere  invertible  function 
G  :  R”  — >  Rmxm  for  which 

h(x,  u)  =  /( x,  K(x)  +  G(x)u) 

for  all  ifR"  and  u  €  Rm;  in  this  case,  we  also  say  x  =  f(x,  u)  is  feedback  equivalent 
to  (2.1)  with  e  =  0  and  F{x1p1u)  =  f(x,p+G(x)u).  The  following  elegant  statement 
follows  directly  from  Proposition  5.2: 

Corollary  5.4.  The  fully  nonlinear  system  (5.1)  is  GAC  if  and  only  if  it  is 
feedback  equivalent  to  a  system  which  is  ISS  for  sampling  and  Euler  solutions. 

Remark  5.5.  Although,  as  shown  by  the  counterexample  (5.3),  it  is  in  general 
impossible  to  obtain  input  to  state  stabilization  (in  the  non-weak  sense)  for  systems 
that  are  not  affine  in  controls,  it  is  still  the  case  that  for  some  restricted  classes  of  sys¬ 
tems  this  objective  can  be  attained,  under  appropriate  neutral-stability  assumptions 
on  the  dynamics.  One  such  class  is  that  of  systems  in  which  the  input  appears  inside 
a  saturation  nonlinearity,  such  as  x  =  f(x,u)  =  fo(x)  +  g(x)a(u).  The  papers  [14] 
and  [5]  (see  [26]  for  an  application  of  these  results  to  the  recursive  design  of  stabilizers 
for  a  large  class  of  systems  with  saturation)  as  well  as  [4]  and  [13]  dealt  with  such 
questions,  for  systems  that  are  linear  in  the  absence  of  the  saturation  (the  fo  and  g 
vector  fields  are  linear  and  constant,  respectively),  while  [2]  obtained  similar  results 
for  more  general  nonlinear  systems. 
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